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On the Estimation of an Eigenvalue by an Additive 
Functional of a Stochastic Process, With Special 
Reference to the Kac-Donsker Method 1 

R. Fortet 

A "Monte Carlo" method is described for the determination of the eigenvalues and the 
Fredholm determinant of certain Fredholm integral equations with positive kernel T(t,r). 
The method is based on a theorem by Kac and Siegert. An appropriate stochastic process 
is constructed from a Poisson process, for the case that T(t y r) depends on t — r only. 

The second part of the paper contains a discussion of the various errors inherent in the 
method of Donsker and Kac for the determination of the lowest eigenvalue of Schrodinger's 
equation. 



1. Introduction 

Kac and Donsker [1, 2] 2 have given a "Monte 
Carlo" method for estimating the smallest eigenvalue 
of a linear operator, when this operator is of a cer- 
tain type. The starting point of their method is to 
consider an additive functional of a Wiener-Levy 
process. In what follows we intend to give: 1°) a 
different method (but which also consists of con- 
sidering an additive functional of a random process) 
of estimating the smallest eigenvalues of some inte- 
gral equations with kernals of nonnegative type; 2°) 
some remarks on the Kac-Donsker method. 

2. Integral Equations With Positive Definite 
Kernel 

For this first part, the following theorem will be 
fundamental. Theorem: Let X(t) be a real, Lapla- 
cian 3 rf, 4 defined for a <Ct<^b (& ai *d b finite) and the 
covariance T(t,r) of which is a continuous function 
of (t,r) on the domain (a^t^b, a^T^b). Let us 
consider the rv: 4 



F= 



= Cx 2 (t)dt 



and the integral equation: 



f(t)-\( b T(t,r)J(r)dr = g(t). 

J a 



(1) 



(2) 



If D(\) is the Fredholm's determinant of the equation 
(2), the cf 6 <j>(v) of Y is equal to D(2iv)~K 

This theorem was stated by Kac and Siegert [3,4] 
(Kac gave only some weaker results, but the generali- 
zation is obvious; we gave a proof of the general 
theorem in [5]). It is easy to give assumptions under 
which the theorem is valid if a= — oo f or b= + oo f or 

i The preparation of this paper was sponsored (in part) by the Office of Naval 
Research. 

2 Figures in brackets indicate the literature references at the end of this paper. 

3 This is, Gaussian. 

< rf, random function; rv, random variable. 

* cf, characteristic function; fr, function of repartition (i. e., cumulative dis- 
tribution function). 



a= — oo and b= + oo ; also it follows from a paper by 
Kac [4] that the theorem remains valid if, instead of 
(1) and (2), we consider the rv: 



J" 

J a 



h(t)X 2 (t)dt, h(t)£0 



and the integral equation: 

'» T(t,r) 



J a 



^h{t)h{r) 



f(r)dr = g(t). 



But for the principle of the method, it will be suffi- 
cient to restrict ourselves to the above statement. 

Principle of the method: We consider an integral equa- 
tion (2), with a continuous kernel of nonnegative type 
r(£,r), and we would like to estimate its smallest 
eigenvalues, and more generally its Fredholm's deter- 
minant D(\). Now r(t,r) f being of nonnegative 
type, may be considered as a covariance of a Lapla- 
cian process X(t), which is entirely determined (see 
[8]) by r(£,r). We assume that some random game 
has been set up that implies a realization of X(t) and, 
consequently, of Y, as defined by (1). We make n 
independent trials, obtaining n values y u y 2 , • • •, 
y n of Y; from these y/s, we can deduce the following 
fr 5 O n (y): 

G n (y)=—X [number of those y/s which are<y]; 

and it is well known that G n (y) is an estimate of the 
fr G(y) of Y. Hence, we have an estimate <l> n (v) of 
cf 4>(v) of Fby: 






e'-dG* (y) 



(3) 



(the integral is extended from only to + °° because 
Y is ^0); but (3) is equivalent to: 



*»w4s«''" ; 



(3)' 
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Now </>(>) is the me 6 of the rv Z(v)=e ivY ; hence 
we obtain an estimate D n (\) of D(\) by the preceding 
theorem, by putting: 



D n (2iv)~- 



1 



4>l(v) 



(4) 



However, v being real in (3) , (4) gives an approxi- 
mation of Z?(X) only for the values of X that are 
purely imaginary; and the roots of D(\), which are 
real and positive, are not obtained by this procedure. 
But we can operate in the two following ways: 

(A) Under the preceding assumptions, D(\) is an 
entire function of genus at most 1; hence D(\) is 
represen table by an entire series: 



D(\) = a +^\ 



+f?x*+ 



(5) 



where the a k s are the derivatives of D(\) for X=0. 
The formula: 

<l>(v) = D(2ivy l 
shows that <t>(v) is indefinitely differentiable for v 
close to and that the a k 's can be deduced from the 
derivatives of </>(#) for v=0. These derivatives are 
equal to i l M u i 2 M 2 , . . ., i k M k , . . ., where the M k 
are the moments of Y, and these moments may be 
estimated, by some well-known statistical procedures, 
from the y/s; hence we can obtain estimates a k of the 
a k s and an approximate representation D n (\) of 
D(\) by: 

n ft" 

But it is well known by statisticians that, if n is not 
very large, it is difficult to obtain good estimates of 
M k for k^>8; it will be necessary, in general, to adopt 
an approximate representation of D(\) by a poly- 
nomial of the following type: 



al 



ttw-ga* 



(6) 



with sg8. But this seems to be sufficient in some 
cases. 7 For instance, in order to estimate the 2 or 3 
lowest roots X b X 2 , X 3 , . . . of D(\), we can obtain 
numerically the lowest roots Xj', X n 2 , ... of (6), 
and these X? may be considered as good approxima- 
tions for X b X 2 , . . . 

(B) We can also employ the following procedure: 
D(X) being an entire function of genus at most 1, 
there are two positive numbers A and p such that: 

\D(\)\^Ae<>'M 

for every X and every p'y>p\ hence, the function 

k o 

' n e, mathematical expectation; the mathematical expectation of a rv AT is 
represented hy K{X). 

7 There is a pood method for obtaining estimates of the lowest roots of a Fred- 
holm determinant when its first coefficients are known. 



considered as a series in — , has a radius of convergence 

o 

— >0, and 
P 



A(*)= f + Vz)(X)dX 



if $ 0)>P>0; hence for every X (and particularly 
for X real and >0), we have: 



1 r+° 



e-M'+WAfa+ifldp (7) 



for any fixed real a>p ; if X is real and <0, the inte- 
gral: 

has a meaning, and, as a consequence of the pre- 
ceding theorem, we have: 



D(\) = <t>(-i^) 2 for X real and <0 



(9) 



Hence we can obtain, by a statistical procedure, an 

estimate of 4>( — i 7>W (8), then an estimate of Z?(X) 

(X<0) by (9), then an estimate of A(a+i$) by (6), 
and finally an estimate of D(\) for X>0 (or for any X) 
by (7). There are two numerical integrations 
[(6) and (7)] to be performed, and this procedure does 
not seem to be of practical interest. 
Realization of the game: Another difficulty lies in the 
practical realization of X(t). This question is also 
interesting from a theoretical point of view. It may 
happen that there is an obvious procedure for this 
realization, with a sufficiently close approximation. 
This happens for instance if a = 0, 6>0 and if 
r(tf, r)=min(£, t) ; in this case, X(t) is a Wiener-Levy 
process (with X(0)=0, 0^<6) and one can see in 
[2] how it is possible to realize (approximately) X(t). 8 

In many cases it is possible to reduce X (t) to a 
Wiener-Levy process, as for instance if X(t) is a 
Markoff process (see [5, p. 198]); that happens if 
r(/,r)=6- & l r -'l, where k is any constant. But in 
general, for a given T(t,r), we do not know if X(t) is 
or is not a Markoff process (to date, there is no 
general theorem about this). On the other hand, 
the reduction of X(t) to a Wiener-Levy process needs 
some computation which, although easy to perform, 
may be lengthy. 

We can look for a realization of X(t) in another 
direction. First, we mention that, X(t) being a 
permanent process, it cannot be realized rigorously: 
we can only obtain a process X*(t) that is an approxi- 
mation of X(t). Then too, the game concerns, not 
F, but 

f*= rx**®dt. 

8 X(t) is a Wiener-Levy process if the r. v. X(r)—X(t) [with T >t] is independent 
of the r. v. X(u) for any u^t, and i f it i s a Laplacian r. v. with m. e. equal to 
and a standard deviation equal to -Jr—t. By definition, T(t, T ) is the m. e. of the 
product X(t) . X( T )=X(t){X(t)-\-[X(r)-X(t)]}, and if X(0)=0, 0^<«, the 
m. e. of this is equal to t, that is to say: min(t, T ), since r>t. 



69 



This substitution is valid only if we can prove that 
the fr of F* is an approximation of that of Y. But, 
because this is an intuitive feature (at least under 
some assumptions), we shall admit it. 

Let N(t) be a Poisson 's process, homogeneous and 
with density m; let R(t,r) be an ordinary function 
defined over the domain d^ —co<^t, r<-f °°, and 
such that, for every /, 

R 2 {t,r)dr<C+ °° (Lebesgue integral.) 

We put: 

N*(f) =N(t) - E[N(t)] =N(t) - mt 

and let X*(t) be the process defined by: 



(r) (10) 



JC*©= lim mq ( iac-4= f R(t,r)dN" 

a->-oo, 0-»+oo [ <y/mJ<x 



(for the definition of a Poisson process, see for in- 
stance [7, p. 212]: for the precise meaning of (10), 
see [5]). In what follows, we shall call such an X*(t) 
a "Poisson's rf". 

In general X*(t) may be simply represented by: 

X*®=-^(j}R(t,T,)-m P" R(t,T)dr) (10)' 



where the r/s are the jumps of N(t). It is possible, 
from a collection of random digits, to realize correctly 
a Poisson 's process: hence it is possible to realize a 
Poisson's rf ; in fact, it is possible to think of a device 
(employing electrical noise, or emission of a- par- 
ticles, etc. . . .) giving X*(t) in a physical way. 

It has been proved (see, for instance [5]), that, if 
m— >+ & , X*(t) tends toward the Laplacian process, 
the co variance T(t,r) of which is given by: 



r(*,r)=J_ ro 



R(t,u)R(T,u)du. 



(ID 



Hence, for a given T(t,r), the problem of realizing 
approximately a Laplacian process X(t) with co- 
variance T(t,T) is solved if we can determine an 
R(t,T) defined over Di, with 



/•+0O 



R 2 (t,T)dT<C+ °° for every t 



and such that (11) would be satisfied, at least over 
the following domain d: 

a^t,T^b. 

Hence, the first step is the theoretical study of the 
existence of solutions R(t,r) for (11); but our prac- 
tical aim will be reached only if there is a solution 
which is easy to determine numerically. We shall 
consider: first a particular case, and second, the 
general case. 

9 mq, in quadratic mean; ac, almost certain (with probability 1); iac means: 
stochastic integral with probability 1. For definition of these terms, see [7]. 



(1) Let us assume that there exists a function 
Ti(r-t) of (r—t) only, defined over D b symmetric and 
of the nonnegative type (over Di), and such that 
T(t,r)=T l (T—t) over d. We shall put h = r—t y 
Ti(r—t)=r(h) ; in this case, X(t) is, at least over the 
interval (a, 6), a stationary process, and r(h) is a 
positive definite function [see (8)]. It is sufficient 
to have a solution of 



IMt-O 






R(t y u) R(j ,u) du 



en). 



over d 1 . It is possible that every solution R(t,r) of 
(ll)i depends on (r—t) only, but that is not sure. 
But it is sufficient to look for this kind of solution; 
that is to say, to look for (real) functions R(u) such 
that: 



/:: 



R 2 (u)du<+o> r(h) = 



it 



B(u)R(u+h)du. 

(11)' 

The corresponding X*(t) will be stationary itself. 
We proved in [9] that (1 1)' has solutions only if r(h) is 
continuous [hence, r(h) is a cf] and if the spectral 
function F(w) of r(h) is absolutely continuous, that is 
to say admits a derivative /(co); in this case, R(u) is a 
solution of (11)' if, and only if, 



R(u)=^Lr^f(u>)e i +^- 
\ 2 wJ — °° 

[Fourier-Plancherel transform] 



<L 



(12) 



where \p (co) is any odd function. 10 We can consider 
that this result and (12) give a convenient answer to 
our problem. 

(2) The general case is much more difficult, and it 
seems that the only result is the following theorem, 
that we proved in [9]. If r(£,r), supposed to be 
defined over d : for instance, is continuous (as a 
function of the two variables t,r) over any bounded 
domain, there is at least one solution for (11), valid 
over Di; but we do not know any easy way to com- 
pute numerically this solution, or any other solution 
(it is easy to see that, in general, (11) has many, and 
even* infinitely many, solutions). Conclusion: The 
interest of the Monte -Carlo method under considera- 
tion here would be that it can give simultaneously 
several eigenvalues of (2) ; but it seems possible to 
perform it only in the case where T(t,r) depends on 
(r—t) only; even in this case, the method is compli- 
cated, but it might be interesting to try it. 

3. The Kac-Donsker Method 
Let us consider the equation: 

K0-7(*)*(i)=-X*(»), (13) 



i° In this paper, T(t,T) and R(t,r) are always supposed to be real. On the other 
hand, it is well known that, if r(h) is a c. f., there is a real nondecreasing function 
F(w)(-oo<oj<+oo), with: F.(-co)=o, F(+a>)=i, and such that: 



(Theorem of Bochner). 



rw =r»° 



«'»»df (<o) 
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whore X is a constant; ^I'(.r) and V(x) are functions 
defined over (— », + °°); V^x) is given and ^0: 



VM^O. 11 



(H) 



Under some general assumptions on V, (13) has 
noimull solutions only for some positive values A } , 

\> X„ . . . of X (these X/s are the eigenvalues 

of (13); we assume the X/s ordered by increasing 
values). Kac and Donsker (see [2]; we adhere to the 
notation of [2]) try to estimate Xj (their method can 
be extended to X 2 , A3, . . ., and also to the computa- 
tion of the corresponding eigenf unctions; but for the 
discussion of the method, we shall restrict ourselves 
to the estimation of Xi), in the following way: 

Let y -V J (x) be the eigenf unction corresponding to 
X,; that is to say the nonnull solution of (13) for 
\=\j] we suppose that the ¥/s are normalized. We 
put 

l(0= {*V[X(u)]du, (**0) 

Jo 

where X{t) is a Wiener-Levy process with AT(0) = 0; 
also we put 



<L(/)] 



(«£0). 



Z (*;/) = exp. 
Kac proved that : 

E[Z(l;t)} = J2 e-W,(0) f "%,(*) dx. (15) 

,/ -CD 

If t is large, we have: 

E [Z(l ; 0] ^e~^ 1 *j (0) f +< ^ (x) dx. 

J -co 

Hence: 

X^lim -\logE[Z(l;t)] 



or: 



Xr 



1 



log#[Z(l;f)] if t is large. (16)! 



We can estimate X, by (16)i, but Kac and Donsker 
showed that, in order to avoid the use of too large 
values of /, it is better to consider two different and 
sufficiently large values of f, t } and t 2) and to estimate 
Xi by: 

, 1 , E[Z{\-M na , 

^t^^imm] (16) 

Now, if X u X-2, . . . , X k , . . . are mutually inde- 
pendent iv with the same fr, eaeh with me equal 
to and standard deviation equal to 1, we put: 



S*=X 1 +X S + 



+x k , 



r„(o=cxp. [-l„(0]. 



ft k<nt 



(17) 

11 It is possible to replace (14) by V(r)^k, where /; is any constant, In com- 
parison with some other papers on Monte-Carlo methods, for instance by Wasow 
[11] (see also [12]), it seems that, in order for the method to be applicable, some 
assumption Oil V is necessary, but a weaker one than (14) ought to be sufficient, 
It would be worth while to study this question. We mention that (13) is a 
Schrodinger's equation. 



Kac proved [1] that, under genera] assumptions on 

\\ if n — >+ °°, the fr of h n (t) tends toward the fr of 
l(0. It follows that E[Y n (t)] tends toward E[Z(l ;/)] 
| here, (14) is essential]; hence, we can estimate 
X, by: 



Xi' 



1 



E[Y n (h)] 

U-tr* E[Y n (t 2 )] 



log 



(16/ 



if n is sufficiently large. Hence the procedure is the 
following: t u t 2 , n being properly chosen, we perform 
a large number m'of independent realizations Y\{t\), 
Yl(t Y \ . . , Frft) and PJ&), F*(* 2 ), . . ., Y?(t 2 ) 
of Y n (ti) and Y n (t 2 ); and we estimate E[Y n (t x )] and 
E[Y n (t 2 )] by the experimental values: 



1 m 
M k=l 



1 m 

m k=i 



For further details on the procedure, see [2]. 
Hence, we have to consider three errors: 

A. A statistical ovviw, arising from the fact that 
U m (ti) and f'"'(t>) are not rigorously equal to 
E\ Y n (U )] and E[Y n (t 2 )]; 

B. An error caused by the fact that E[l n (ti)] and 
E[Y n (t 2 )] are not rigorously equal to E[Z(l;ti)] and 
E[Z(l;t 2 )] [replacemenl of (16) by (16)']; 

C. An error caused by the fact that (16) is only 
an approximation. 

There is a fourth error, because the random digits, 
which we are ultimately obliged to use in the compu- 
tational procedure, are never perfect random digits; 
but this error seems to us very small in comparison 
to A, B, C. In fact, in all the experiments performed 
to date, of which t Ik* author is aware, the results are 
in good agreement with a hypothesis of perfect ran- 
domness of the random digits; consequently, we shall 
not consider this error in what follows. 

Discussion of the errors A, B, C: It will be con- 
venient for the discussion to take a definite example, 
so we shall take V(x)=x 2 , because in this case the 
\/s and the \p/s are known; but we shall see that 
some of the conclusions may depend on V. We 
assume / 2 <^o 

C. Error C is the easiest to discuss. It is not 
connected with probability theory. We can readily 
estimate the proper order of magnitude for t { and t 2 : 
if V(x)=x 2 , \ 1= 0,707, . . ., X 2 = 2,121 . . ., X ; = 

-^-7=—, . . . ; if t 2 is about 3 or 4, and (t l —t 2 ) about 
V2 

1 or 2, the absolute error is about 1/200; we need 
relatively large values, as: t 2 = 5, ti=8, to have the 
error about 1/1000. For further details, see [2]. 
In what follows, we assume that U and t 2 are definitely 
chosen. 

B. We know almost nothing about error B; when 
ti and t 2 are fixed, it depends on two elements: the 
fr of the AYs, and the value of n. Let us assume 
that the AYs have the following fr: 

Pr(X k =l) = Pr(X k =-\) = l 
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The function V(x)=z 2 increases relatively quickly 
with x; and the expected order of magnitude of|S fc |, 
which is -yjk, also increases ; hence we can admit that, 
in (17) only the S k 's with k^nt/d, where d is some- 
thing like 3, are important ; hence it will be necessary, 
in order that B be small, that the iS^s, for k^nt/3 
have a fr close to Laplace's fr. From known results, 
see [7], p. 153 — , it follows that we must take nt ^ 1000 
for a fair approximation, and nt ^2000 for a good 
approximation. We do not get a precise estimate 
of the error B by this argument but we see that, in 
order to be able to take an n which is not too large, 
it is better to take for the X k 's a symmetric fr; 
because in this case there is a faster approach to 
Laplace's law. It is clearly best to take the X k 's 
(and hence the S k s) directly with a Laplace's law: 
this is more complicated from a practical point of 
view; however it is possible to realize a Laplaciaii 
rv with a good approximation. In this case, it is 
possible to obtain an estimate of the error. For we 
can suppose that Sj-y/n is X (k/n), and if X n (t) is the 
rf defined bv: 



h(t) and L n (t) being ^0, we have: 

< 6~ L(0 +dL(0 ~ 6Ij n CO < 1 



X n (t)=x(-)iov: -<t< 



k+1 



we have 



If V{x) = x 2 , we can write: 

i#)-l.(0- JJ [X\u)-Xl{u)]du 

= P [X{u) + X n {u)][X{u)-X n {u)]du; 
Jo 

£(iL(Q-L„(0!);g P E(\X(u)+X n (u)\\X(u)-X n (u)\)du. 
Jo 

By Schwarz's inequality, we have 

E(\X(u) + X n (u) | \X(u) - X v (u) |) 

;g jE{ [X(u) + X n (u)?} XE{ [X(u)-X n {u)Y} 

*V(- + 'SX-£) 

where k n is the largest integer such that: k n [n^u. 
It follows that: 

£(|l(0-l„(0|)^2/3^ 
-y/n 

Hence; 

Z(l;t)-Y n (t) = -[i,(t)-LM'e- ut)+dMt) - ei 'n^ 



Hence 



\Z(l;t)-Y n (t)\^(t)-^n(t)\ 

\E[Z(1$]-E[YM\£W 






(18) 



An analogous result may be obtained for V(x) = \x\ a 
with a equals to any nonnegative number; and 
more generally for a large class of nonnegative 
functions V(z). For V(;x) = \x\ a with -l<a<0 
(see appendix) it seems more difficult to obtain a 
limitation like (18). 

But (18) gives an upper bound for an absolute 
error, and we need rather a bound for a relative error; 
but it seems more difficult to obtain this. 

On the other hand, we are not sure that (18) is 
the least upper bound for the absolute error; about 
this, we can say two things: 

(1) In (18) the orders of magnitude with respect 
to n and with respect to t seem to be the right orders; 
hence the absolute error is increasing when t is in- 
creasing for a given fixed n. We know that, for 
error C, we have to take t sufficiently large. With 
V(x)=x 2 the following bad feature appears, which 
will be called the feature u F 1 yj in what follows. It 
is that 

E[Z(l;t)]=[ch(t^2)]~" [see appendix (23)] 

is exponentially decreasing when £->+ °o ; hence the 
relative error is quickly increasing. For instance, 
if we choose 2 = 5 (which is not a very large value), 
we have 

#[Z(1;5)]«0,043 

and if we use (18), we find that we have to take 
71^3000 in order to have a relative error about 
1/100. 

F x seems to be related to the fact that V(x) = x 2 
is not bounded as x-^-{- °° . 

(2) From the experiments performed to date, the 
error B seems smaller than indicated by (18); prob- 
ably, the coefficient % in (18) may be replaced by a 
smaller one; this does not eliminate F 1} but it does 
perhaps indicate that F x is not very important 
practically. 

A. We shall now discuss the probable order of 
magnitude of the error A, as a function of m; this 
order, for the relative error, is a/fi-yjm, where /x is 
the me of Y n (t) and cr its standard deviation. We 
know neither \± nor a; but (18) shows that /x is close 
to E[Z(l;t)]j if n is large (but that is necessary for 
B). It is easy to obtain an analogous inequality 
which shows that a is close to the standard deviation 
of Z(l;t); it is possible to avoid this interference of 
two unknown quantities /x and o-, with a slight 
modification of our procedure, but it seems sufficient 
for our purpose to identify /x with E{Z(\ ;t)] and <r 
with the standard deviation of Z(l;t). 
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With V (x) = x 2 , we know that ^=[ch(t^2)]- 1A , 
that is to say: /x~ 0,043 for £=5; we have also [see 
appendix (21)]: 

E[Z(l;t) 2 ] = E[e- 2 ^ = E[Z(2;t)] = (ch2t)- 1A 

that is to say, if £ = 5: 

E[Z(l;5) 2 ] = 0,000953. 
Hence 

a 2 =E[Z(l;o) 2 ]-{E[Z(l;5)]] 2 ^10- i '75.S 
°-~2. 

To have a negligible probability of a relative error 
of more than one percent, we have to take ra=4.10 4 , 
which is a very large number. The reason is that we 
encounter a second bad feature, the following feature 

ttp 77. 

We have: 

H=E[Z(l;t)] = [ch(tj2)-* 

v 2 =E[Z(l)t) 2 )-{E[Z(];t)]} 2 =(ch2t)- y *-(ch^2t)- 1 . 
Hence if t is large (in fact, for t^>2): 

M -V2e V2 <r-2 4 6 2 
— ^2 e 



which tends toward + oowhen t-^-\- °°. 

Another aspect of the same fact is the following: 
more generally, we take V{x) = \x\ a , with a> — 1 
(see appendix); let G(t;a) and G(a) be the fr's of 
l(0 and l(1); we can write: 



Jo 



e~ a dG(t;a). 

But, if v=E[h(l)] and if 5 is the standard deviation 
of l (1), we can deduce from a remark in the appen- 
dix, and an integration by parts, that: 

E[Z(l;f)= -G(-£)+£°'G(l3)e-°da. 

With a being any fixed positive number, we put: 

a 

(*bat l + ~z 

A(a,',t)= G(0)e-«da 

Jo 

B(a',t)=( ~«G{ff)e-«da^e- m ~ 1 ^ 

Jdat 2 

Hence 

E[Z(l;t)]=-G^ — V ^ + A(a;t)+B(a;t). 



We known by [2] that: 

#[Z(l;*)]=e<- x i + «i>< 
where ei— >0 if £-*+ » . Hence, if <O>0 y we have 

X 1= -Km Il O g[-(?(-|)+A(a;0] 

and this is valid for any a>0;— G (— vjb) +A(a; t) 
is depending only on the values of G(n) for:— v/B^ 
li^—v/8-\-a. Hence Xi is a local characteristic of 
G(a), in the neighborhood (and to the right) of the 
value a=—v/8; hence a good estimation of Xi is 
equivalent is a good local statistical estimation of 
G(a) [implying, for instance, a good estimation of 
several derivatives of G(a) for a=—v/8]. It is 
obvious and well known that such an estimation is 
very difficult. 

But this conclusion may become wrong if a SO; 
that is to say, if a^0, the feature F 2 may disappear. 

Conclusion: We can conclude that the Kac- 
Donsker method gives an asymptotic estimation of 
Xij that is to say that we must take t sufficiently 
large [we saw that values like 4 or 5 are scarcely 
sufficient]; but when t is large, features F\ and F 2 
imply that n and m have to be very large. The 
computation will therefore be a lengthy one if even 
only very nominal accuracy is to be achieved. This 
is valid for V(x)=x 2 and for a large class of some 
increasing V of the same kind. 

But we saw that F 2 may disappear for V(x) = \x\ a 
with «<0; perhaps F x may also disappear in such a 
case, and consequently the method may be much 
better. Hence, it seems that we have two problems: 

(a) To examine if there is a class of V's such as 
features F x and F 2 disappear for V belonging to this 
class. 

(b) To examine if the method can be improved, 
even when F x and F 2 are present, eventually by 
some change in the method or in the procedure. 

Concerning problem (b), we report the following 
remark by M. Kac: if we consider, instead of 
E[Z(l;t)], 

E{Z{\;t)HX{t)}}, 



then he has proved that : 12 

E{Z(l;t) . UX(t)]}=e-^U0). 



Hence 



Xi=- 



1 



u-u 



log 



z(\^ux(m 

Z(l',t 2 )UX(t 2 )} 



(19) 
(20) 



Now (20) is no longer an asymptotic result and we 
can choose U and t 2 as we like. Hence we have the 
following method: we use Z(l;t) fa[X(t)] instead of 
Z(l;t); and with t { and t 2 sufficiently small, Fi 
disappears, and also F 2 , at least in the case V(x)=x 2 . 
The difficulty is that we have to know \pi in 
advance. But in practice we need only a rough 
approximation of ^; it may even be sufficient, 

i 2 M. Kac will soon publish the proof and some complementary explanations. 
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practically, to operate, instead of fa, 
function \p such that 



with any 



£ 



fax)fa(x) dx 



is small. (In this case, (19) is not rigorous, but 
may be a sufficient approximation). Under these 
conditions, it seems possible to determine such a \f/ 
by a preliminary rough experiment; it would be 
interesting to try it, but in any case the Kac-Donsker 
method became more complicated. 

It appears that in general [even if V(x)^x 2 ], this 
procedure will avoid Fi; but in some interesting 
cases, F 2 still remains. For instance, Kac has 
studied a three-dimensional case, where (13) is 
replaced by: 

|a^-^=-X* (13a) 

where 



It is a complicated case, because (13a) has not only 
a discrete spectrum, but also a continuous one. 
However the method can be applied, with a 3- 
dimensional Wiener-Levy process [X(t), Y(t), Z(t)], 
and putting 



L© 



Jo -V 



1 



/X 2 (u) + Y 2 (u) + Z 2 (u) 



du. 



It happens that, with the introduction of fa as above, 
we can avoid F x , but not F 2 , in the sense that the 
ratio a/n remains large even for small t. The reason 
is that for small t, [X 2 (t) + Y 2 (t) + Z 2 (t)]~ H is very 
large. 

A useful device in many Monte Carlo methods is 
"importance sampling" which consists in playing 
the game not with the natural distribution functions, 
but with some other distribution functions con- 
veniently chosen. But here the game is played 
with the distribution function of the X k 's, and Kac 
has proved that this distribution function is practi- 
cally irrelevant. 

The greatest hope seems in the following direction. 
Considering the case V(x)=x 2 , for instance, we saw 
that the problem reduces to a good statistical deter- 
mination of 6(a) for a close to v/8. Let m be the 
total number of samples; let N m be the number of 
the samples for which 

where a is a given positive small number. The 
determination of 6(a), in the neighborhood of 
— vjb, may be considered good if N n is greater than a 
definite number N; we can stop the game for the 
first m such that 

N m >N 



and, by chance, this may happen for a relatively 
small m: in other words, we can follow a sequential 
procedure. 

On the other hand, the fact that Xi is a local 
characteristic of 6(a) in the neighborhood of — v/5 
does mean that the knowledge of 6(a) for some other 
values of a cannot give information about Xi. We 
can consider the general problem of the statistical 
analysis of the results with respect to the spectrum 
of (13); but in the present state of the statistics, 
there seems to be little hope in this direction. 
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5. Appendix 

X(t) being a Wiener-Levy process, with X(0)=0, we con- 
sider the following functional: 



L(0 



=J> (W)I ° 



du 



«>0). 



This stochastic integral has a meaning when a^> — 1, in the 
following sense: X{t) being ac a continuous function, |X(0| a 
is ac a continuous function, and the integral 



r 



\X(u)\"du- 



exists, but may be infinite. But if «> — 1, it is ac finite, 
because in the first place, 



E(\X(u)\" = -yL= [ +a> \x\"e~*»dx=Ku 1 
■J2tuJ- co 



yhere 



1 f + 00 

£=-== I 



dy> 



and K is <+ oo if «> —1. Therefore 
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a 

E[h(t)]= rE|Z(u)|«dw=K:j u 2 du< + oo, 

the firsi member of the equality following from Fubini's 
Theorem. In what follows we suppose «> — 1. Now l(0 

»+l 

lias the same law as £ l(1) does, because, if we put u = tv, 
we have 

L(0=«jP|X(te)| a <k 

and if we consider X(tv)/^t , it may be considered as a 
Wiener-Levy process in respect to v only; hence we have 



where 



firwi- 



L«)=* 2 J o |r(»)|- 



dv 



dv has the same law as l (1) does. 



As an application of the preceding formula, the value of 
E[Z(s;t)] for a = 2 will now be computed. 

We know, bv the theorem of Part I, that (he cf <f>(v) of l(1) 
_1 

is equal to D(2iv) 2 , where D(\) is the Fredholm's determinant 
of the integral equation 



/(/)-xf 1 min(^,r)/(T)dr, 



(21) 



since r(f,r)=min (/,r) for a Wiener-Levy process; from (21) 
we deduce 

f(t) = \^rf(r)dT + \tJ t l f(r)dr. 
Hence /(0)=0; then 



f f (t) = \£f(r)dr 



hence /'(1)=0; then 



f"(t) = -\f(t). 



(22) 



Hence (21) is equivalent to (22), with the boundary conditions 
/(0) =/'(l) =0. The solutions of (22) are 

f(t)=A cos ^fct + B sin ^\t. 

In order to have /(0)=/'(l)=0, we must have ^1 = and 
X = tt 2 /4 (1 + 2&) 2 (k = 0, 1, 2, . . .); hence, putting \ = n 2 , we 
have 



D(X) = 



*[ |-(1+»)»J *|_ |{1 + 2A:)J 



COS /i = COS (V^)* 



Therefore 



<f> (y) = cos i^j2iv) 



Now <f>(v) is equal to i?[<? ll ' L(1) ]; hence, in the notation of the 
preceding pages 

_i _1 

E [Z(s;l)] = E[e-°^w]=<f> (is) = (cosies) 2 =(chV2a) 2 . 
Now, from an earlier remark, we have 

E[Z(s;t)] = E[e-^^] = E[e-" 2 L(i)] = E[Z(st' 2 ;l)]. 
Hence 



E[Z(s;t)] = [ch(t^)] 



Los Angeles, January 26, 1951. 



(23) 
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